City Escape has cars, and spindashing doesn't require the A button. If you can complete the level, A is possible.
I wonder if the board in Metal Harbor (DC only) would be able to lower the A count there to 3 (possibly only in hard mode?)
All of the hunting stages are possible, except maybe Pumpkin Hill, pursuant to whether A button on a previous life (necessary to set up the rising start) counts toward the total. Other hunting activities don't work, mainly because you can't climb a wall without hitting A.